Skip to content

Upgrade Pulsar version to 4.1.1#23

Merged
liangyepianzhou merged 1 commit into
apache:mainfrom
XHS-R-D:main-updatePulsarPom
Nov 12, 2025
Merged

Upgrade Pulsar version to 4.1.1#23
liangyepianzhou merged 1 commit into
apache:mainfrom
XHS-R-D:main-updatePulsarPom

Conversation

@StevenLuMT
Copy link
Copy Markdown
Member

@StevenLuMT StevenLuMT commented Nov 4, 2025

Upgrade Pulsar version to 4.1.1
Main features include:

  1. PIP-415 is very useful,a new API to get the message id by offset(https://lists.apache.org/thread/j9vxmmsw1r85l27v3rgp9tcnllk48wyb)

@StevenLuMT StevenLuMT changed the title Upgrade Pulsar version to 4.0.8 Upgrade Pulsar version to 4.1.1 Nov 12, 2025
@liangyepianzhou liangyepianzhou self-requested a review November 12, 2025 11:17
@liangyepianzhou liangyepianzhou merged commit c3cf0b2 into apache:main Nov 12, 2025
2 checks passed
liangyepianzhou pushed a commit that referenced this pull request May 13, 2026
### Motivation
Our organization is currently planning a migration from RocketMQ to Pulsar. To facilitate this transition, we aim to implement a standardized abstraction layer for MQ clients that encapsulates implementation details of specific messaging systems. This abstraction layer will allow seamless engine replacement while maintaining consistent client interfaces. However, two critical compatibility issues hinder the unification of message fetching patterns between RocketMQ/Kafka and Pulsar:

**1. Interface Disparity:**

- Pulsar currently lacks native support for offset-based message fetching (fetch/pull paradigm) that allows specifying exact message positions and batch sizes.

**2. Positioning Mechanism Mismatch:**

- RocketMQ/Kafka: Utilize monotonically increasing numerical offsets for message positioning and acknowledgment
- Pulsar: Relies on composite MessageID (ledgerId + entryId + batchIndex) for message identification.

Therefore, I propose to contribute a customized feature implementation to the Pulsar contributor repository that leverages existing Pulsar APIs to achieve functionality similar to RocketMQ's pull consumer. This implementation could serve companies like ours with standardized client requirements, allowing them to reuse this solution.


### Modifications
1. Upgrade Pulsar version to 4.0.8(features include PIP-415 a new API to get the message id by offset) #23 
2. Implement RocketMQ-like pull consumer functionality using existing Pulsar APIs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants